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(54) METHOD AND SYSTEM FOR SPEECH RECOGNITION BY COMMON 
VmTUAL PICTURE AND STORAGE MEDIUM STORED WITH SPEECH 
RECOGNITION PROGRAM BY COMMON VIRTUAL PICTURE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To enable efficient vocal transmission of an intension to an 
object in a common virtual picture by allowing a grammar management server to 
distribute difference information of grammar needed for speech recognition to a user 
terminal. 

SOLUTION: The system has a grammar management server which manages the grammar 
having a recognition object vocabulary registered in a text, etc., and a speech recognition 
result distribution server which distributes a speech recognition result. When a user 
terminal requests the grammar management server to update the difference information of 
the grammar needed for speech recognition (SI), the grammar management server 
distributes necessary difference information of the grammar to the user terminal at the 
start of the speech recognition (S2). The user terminal updates the grammar according to 
the distributed difference information (S3), recognizes an input voice by using the updated 
grammar (S4), and extracts (S5) and distributes (S6) the most likelihood vocabulary in the 
vocabulary in the recognition result to the distribution server. The distribution server 



distributes it to other user terminals (S7). 
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wit* «nHWwmtt-><fc fc*u 

«i»fc^^Xa<OM^Hfffi2ris^-^«*KE<it* 
£ k t*^^WBtJ3»t**? f B«»t£. 

%Pimiz&Wj:3--fib 3 <^)fHi* r ^ k WIS* f > 
k fc^ftk^Ktelrt • «at*l**51 1 EHO^MBS 

Bffltfcft*^^ms-a. 
[11*155] jL-^m^izmtx . jl— r*w>* 

^fSBSfrt* £ k *nr«arftfl-<raSBiBt:«»t 

U 

1HBtlfcJ.-lWI*fci!flrL. 

UfE-x— jWWifctJVvc, WEfcffi*lt-^^E« 

kLTttiBU 

lilE^WBaWSS ^ff^BMeiSBtlt-' N'tiMfi L . 
liffiWWSWSflliMit-^fcJS^T , 

a— f H*tcEfllt4 i k ^#®k t**m'SfflE{w 

[M*«6] i— mm&iz&tx. jl— w»w>* 
^ktcj: i)««s<tfcsafe*flat*xa«at-^ 



Eftt-A*k££U 
TUESaSWlt-A'tt. 

ats^ffii^^Sk . 

mm iz <m%z-— f ?* i ots* k wis* 

k *XffikfttlMft • •StStT/Mftlft^Ri: . 

m^f^Rx/mimm^f^m^x^pmmth^p 

fflE a— f Si** 1 £> M fl £ iut fWBiWSS S: ffi<0 jl- 
1rtl*fc:E«t**R**t6 1 k iHtGSk t*##fi 

[ff #il 7 3 a—f tf . a~f #M#>* 

m $ tit &Gm§MW t fi ft * #«g»7*n ^ 5 A £ *S 

«to»4«fe«aMMii«tRA-- rs*tcEfit* 

[»«S8] a— fO&SfcJBCT. a— mifeA* 

^-y*«nssewt* - k^^i— 

k **SkftJclStt#R08tt • *fat*rn-fexk» 
ff?W*ff3fctoe^!SrXffiS:WIt*XSWIt 

Tn-bXk. 

mtTiiim^xgpmmtira-txt . 

»I2HS$ ^SmSrfriE^fSISSiteSE^-A'Cjll 
fi^^ro-fexk tqrtiik ^1*akt*ft*«Si 

ft * ^tgaSr o / 9 A §r fetA t IE1g«#:. 
[000 1 ] 

vh^pumnw&vi'ZT&m^mm&izm 

BSfft*cikA^Ttg^m«iifflfcfcv^. -eoft 
i{ESSffiS:^LTafSSn*W^S:^t*^rA 
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«Hffll*ltf>*ttM;:*f LTWC <k * J&fi3i*fr 3 8£ 
fc . »WCfJ»C J: SSSUStfcff 5 fcfcfclWMr* 

[00023 

£*rLT-tfw*SBK««§*u tlgScOa— W3&7E 

*#anS#S£fc#T&S380E&#<BB2Elk LT 
{4. f?!l;t(4\ Interspace (http://wi«w. ntts.com/ispace. 
html) Wbh. Z^XtMzH^X. 2--Wr?4? 

[00 0 3] -Jr. ABlolStSSISavKa-^tia 

& 0 * k'Srff ? fcabKUdHRrfttBT* 0 . v/H-* r 

^-yhy-^fctftrt^WBItS/X^AfcLT 
(±, ?547:'hfr&A*3ftfc£*T-*£*-'*fc 

7&imt&i&&tz* ffiX (ipomt) 7 XT- 
is 3 ym&?->Vzmm L. ffiflflKr^-V >e 

[00043 HR««mglWKBi. W»J»*«Wt 

■*-&k*t*&*** (WH^tftk) *mtt. # 
tmmiz&vmmg.mzMs.t&tzihnmm*?*. 

TfcSWHtT'K mmitm«ll** s T**r- : 5:k'£ 
t — 9 (ff^«») W#«fL, fFP®»t:«ai 5 Sr& 

J&lZ%BZtlX^hM%<V*ZlU£<?)&t>-iS 

\.ymimmmskb lt**s . 

[00053 

[0 0 0 63 L0»L&#£. ««Sfc LT*1#SgfS*ffl<7) 



fHKf*^ k IH^O^^IgfiStttgSrft 5 £ b iML <% 
•>tv>i. ifc. AIBoMW£«ftfc*»t:*tLTflf* 
■CKSfiit * c k (flUtf, *«f * 9 7 * W* LT 
rfc#j * r iiJl 0 j frif** J*-C**t4 i k ) i4S 
HT'cfo 4 . 

[0007 3 Z0)£olZ. $&k(D*vh7—7iftLX 

Kmzmz'nozbimmxh*). #%.0>B%mizft 

#&MM 1 £ J f t A>b PWWffWUHHBS*** Zblt 

rare**.. 

[ o o o 8 3 m&ymisagmmtot.tsftttp 

v>4. iittt, ABOUT/I'M a^a*w^t 
atj>o. Miar, ±ieo«t9^AScofiiff^itft^ 

& bco^pi,z x * tti&Bth z b immx-h h . 

[ 0 0 0 9 3 JJBWfl£*wafBt:li. 
SSNSffiai LT v vflrv ^^r(E®Bffirt^M*^*t LT WJ« 

S Irff d i k #T # =Sr v v ^HA^ S . , 
±fB^t^^r§ii^t>^T. i-lfjWSSSIWLT 
v^^WfiD8affirtO««tcStLTff^fc:J:-6K,Sfi 

[00 103 

[IHI*«W5-f *fcA^)¥R3 *^ a J (HfcfcJSl ) »i. 

mti z b iMmtc^wmm^za n& ^pvmum 
fcxm&gm-tzx&m-v-^b. w^sa^msa 

3--fffi*t,ZRmt& . 

[00113 *»W (if*«2 ) 14, a-f «*(C*JV^ 

t, ff^iitofi^A-ifaiwtwef'^ktH* 
r/Uk &Xffik*l2»tt • «W*. *% S J (««« 
3) (4, a— !fii*fc:*{V^T, A^$n^#^Sri— <f 
*B*fc*}V^TS2fe. W^T^aiA'tlB^T^Srffl^T 
fPWWt*. **HH <lt**4 ) ti, i— 

^t , mm^tifz^^pum^^mv-^z 
[ o o 1 2 3 n i f4. *mi<nwjm®mx'hh . 
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=5r if t 4 o fins *a-r sxa***-^" 

*^Efi$ftfc3l4Hi$£3mbT:8££3glSrL (Xf 

•y7*3 ) . lEfrSflfcXafcfflVvc. 

WWBItfcffv* (Xf7/4) > W*BWtf>*i*<Dfi* 

75) , *^BI^**#)«BWS»E»9---^*fc3»t 
L (Xf-y76) . «W0WtiHEflW--^»V^. 

JfcicEfrfft (^f777) . 
[ 0 0 1 3 ] 112(4, *HW<OflClfllJ&H-C** . 

08 m^me) (4, z.-w^j&zmtx, ^.-fam 

Aft v->"£ffiHs8&rf ft £ jJ^It&&#fHK«aiBtc 
fK 10 0t, BIWt*H*a t f' b£k'C:4 0® 
BWS*S:i— f *B* 1 0 0 CSfttftmglttt&AE 

ook **u o ott, is 

i-ft££W£& iok, =L—f^.(D^pwmm^ 

f ft«4M» ?&Efi#K 2 0 k U 

a— 0 0(4, ««i(C*»ri—«fci«)» 
S*T/Pk gfS^T/l'k ££3; k *(::*&& • l^tft^ 
r/M6tt#»3 0 k , XftSfufeWSi— W»t=« 

•fft^ig^S4 o k , mmf-m ox%htitz 

*U *«aHS«iflW^-^3 0 0l4, i-if«*l 
fttft^Sfc^Tfft. 

[0014] **BH <M#57J (4, i--ftf>m£CJE 
CT. a— (f^mAft^-y&fiSBSff-rft-k* 5 ^ 
&^M^^«^S*ift^RSBffiC*J»tftW 

^Xffi«^>S3MB«SrSt3.-if«*tE<ri-ft • 
[0015] *»H)i (ft*«8 ) f4, a-f«l:(ti 
£"C. a— WRA-ftS"- ySrfiiBHfr-tft-k* 5 ^ 
^i-ifS*^tt$tiftftm«Bffi^fcttft^MZ 



^'Sri— ^tiAWS^T/Wk Wl^T/l'k £:fc£k 
£tcEtt*RC*ltt • fStftTD-fexk, OTHtt 
3 fctf>fc£5Kr;fciS £*31- ft ^a^I^-A^E 

k, TJjSfifcWFfcm WS^T^S.lXmfl^T^ 

fcfflvvc^mgatftrn-feak. ms*3*i*:i£% 

^^igtiteSEfi-f-^'^iM^t^^ftro-feXkSrW 

1-ft. 

[0016] ±15^4 0 £, *»«4. ISi&ttftfgftft 

g-?w\*k. *MMWI*ta— fig^CEdl-ft^ 
I2m*Eli-9--^*k$r*L, *S i &J*BMfc*«-ftffl 

Mzmvbiix^&x&mv-jvzh^x . i-t's 
zimtizzmzm^x. AijWz^pommz 

'ft \\ W^I^^^cfeSSr^l^^SE^-^'t 

ransA^ r jg*(cEft-r ft £kt4o, a.- 

[00 17] 

[%$<0ltlfcaft]||] 03(4, *8fm*PVMi'Z?- 

0 0 , X&WS^-^' 2 0 0, MHtBJREflWw* 
3 0 0&tf*-y>7-?4 0 0*><offj££ft, i-ifffi 
* 1 0 0 , 0 0 , Kt^W raMSAE 
ff-9— A3 0 0(4*-y h7-?4 0 OfcftttMvO* 
ft. 

[0018] jl— fs*i o ot4, f-ft mst 1 1 

0, %Mtmm&l20. fHP^T/HdUBiBl 3 0. 
WMMWKI* 14 0. :8£H«Tg*SG 150, 

1 6 O&ZtflfflHtfHff 1 7 0*>fe«BKS<tft. =Srfc. i 
ISa— Tffl*l 0 0(S, H3fc«VvCliKW0«*fltf> 
fcftl^*7 h7-^fciS«*<iTV^ft*<, **{4, 
nS«?ixti^ tOk-fft. 

[0019] r-^fSSP 1 1 0(4. ff^BIKH^KC^ 

• «SWft. XS#««ai 2 0(4. flSIKtft^K^ 

■fjf x h^k(c4 •jansiuti— me<oxa*ff« 

-fft. f»Ef;HB»l 3 0(4, ffjs*A*-fft 1 8 
0 i--y«off#Rfttfc:-&*>*T^»^S#»<»>W ; Ef' 

«ffflcS8J6S-frft. ®JE$*ftfl:#;W^^ffi 
(4, ^^r/lolJSS? 1 3 0C4 O^SSBl 6 0(c*r< 
Sfufe^Hfl!^. i-if 18 0(4, ^ItffietfflOfF 
ftf;W:i)5f^ • ^££-C«-rft4 
ffv^, titf/«31 3 0(4, ^Affrta^a-lf 

[0020] mmtmu 1 4 0 (4, r- ^^ags 1 
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1 0K4 •)*SS*xfcWW8H»raKs&3KrT-*£JfI 

tit* mamxMMtti. sasE*»*«i so 

HI, Wi?BSB&aaBl 4 0K4 OOTSiiSrfi^ttiiK 

^*wsoiiMf««3Wt*ifeWir-^<2 o ok 

ttLTSSSt-fft. H*S5 16 0(4. a~fl8 0fc*tL 
[0021] 9flmWPS 1 7 0(4. ^afs^-^'2 0 

*. xi6wi'^-^2ooa. sb&ffranttfluctt? 

§ a— f WiAWfcf&ft 3 & %WM<r>3-— 9 

0 . £?£t-:J"<.-* 2 10. ttSRSS 2 20. a- H» 

2 30, 7v7o-F»24 0&irafiWW»2 5 0a» 
<->fl»j£S*l4. 

[0022] XffiT-?"*.-* 2 1 0(4. a— 1 
0 0*fc&«Sftfc:fc8HI!««:«*ft ■ «S*4. 
2 2 0 (4. a.— !f «* 1 0 0 a:8S8W**S 1 4 0 
fe»*8fifcK«lca6^V^TS26f f -^ / ^-^2 1 0£ 
n-h'gB2 3 0(4. «BWS2 2 0-C«BU3*l 
fca-i?SS5|U 0 0to?-fVmi 1 OK J: OfcSiS 

[00 23] 7'y7'n-h'gff2 4 0(4. a-iffi*10 

1 OK 

77TD- F-f 4 . WiGltttf 2 5 0(4. a— f 1 
0(4. a— fig* l 0 o*fc»f»LfcOT8W6**a 

f8*sii«Jia5 3io. E«a— wn» 320. aim 

«»3 3 0*»^»«Sit6. 
[0024] WPBStSaPBlSS 1 0 14. a-f«* 

EUa— TMS3 2 0(4. *mgltlgjRffiIffi3 1 0 
TW«*WS»l6**E<W*a-ir»lKl 0 OS: 
WW"*. EfrrSa-HfS*oaS)?{4. ^JSTl 0- 
34739 6KIB*SiiTV^"7^^i|5feO»R*i6{C 

[0025] ffift$iJfflgB3 3 0(4. a— wm 1 0 0 k 

waft****-* . &k. *^«osi^o«^SrUiW 

IS^fflt''5r<{SA^###tt2rp:B|*it^^# ; E7 r ;H4fli 
/?Oa— fffi*l OOKffltU ft*>a— FaS**** 
ffl«oa-iWftsj£l,fc£ai4, Sttfc&fcffiftl'fca 
-If** 1 0 0 gfrKWBt* k£K. flW>a— f 

*?* 445 \,z-xmm-^2 o o tisti . 
[0026] a— rm% i o owx&fttfM&m 1 2 0 

KiOll^Oa— WffJSUfcXati. a— fSB*l 0 

otfHuiswsi i o , %&m?-><2 o ooafifw 

» 2 5 0 7 y m- H » 2 4 0 1 ^ UT*J6^- 
^-^2 10K5eW-»«S*i*. £aW&3i 



IJ<0£ft(4. JStfca— •WB*10 0<Ot-^«3»1 1 
0K#»3*l4«l:oKl/Ci&^U a— «f«*i0 0 
^r-^faSR 1 1 0 kXar-^<-a2 1 0 
^KSDttl.4 3KLTi4v\ 

[0027] ®*<njL-i i n*^<?>mix&<?>mm® 

(4. JaT<94pKLTff3t><0fc-f!>. IS 1 

mm t ix . ^j»Kaw«*a— r 1 8 o jwmjr t . 

SllirflRl 0 0*^^ffiSfrS«Srf6ff 
*KRfc**SOl^fl!^»t*3BRt6. a— fig* 

w-a'2 o o izmmth . 

[0028] &K. X8afl»9w<2 0 0T(4, jgftS 

£(t. 1 ocotiffirt—is -a ycyXA 

t ^Mfff8£a-if ig* 1 0 0 KjgflWi . 312 ffyX 

/l/ h" Tt4(RIK#A*31 1 4 sfifB*** 4) K. 

a'2 0 0*><5a-f «*1 0 0fcttl/tS3£lSfrfcfH 

[0029] £<9^tf«8SeWSIBi. fllitf . a- 
-fSg* 1 0 0 1P7—)V \ i< §m j f-^ ( H^<Oa- 
1fc7)o^y. D^7»>hS: , i : S-t4- , f-^' (0** 

?8^*&a— fS*l 0 0KjHf|-t4. 
[0030] »3«XifeOR«»rai: tT. 
«tfX6*»fea— f OTA^fcifi^V^T £ T . S»WK* 

Stf*Xft^<-^3 >5rffot^T. a— r^TA'^K. 
*4KH«0l©tKifi^v^i»fc:. a-if«*i 0 0 Kg 

ltS!U **-?T^4*^l4. a— yJt*OXftA'-s; 

f*TJOW4. a-if<07A"^KJ)4KH^gg 

[0031 ] <XK. ±IBcoffl«K44 ^BWtPKOK 

mmm-h. 04 14, *w»i»7d- 

f-v-hTS>4. 

X7 1 ••/ ri 0 1 ) a— f 10 0(4. XffiSffS* 
S51 5OK4 0. 3 BK«e«i: *4Ai6^> 

*^5rfJS-T4. SST2rffa^S* { $>4^K(4. a 
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r -y 71 0 2 fc»ff L . sBB* 6 ^ 4HfttWf 7 7* 1 
0 3fc#4rf4,. 

[0032] Xr-y7'102) Xft^Si^- A' 2 0 0 
On- k» 2 3 0 £ J: 0 a- F 8*ifc*iS0>IHHIHIfc 
S-*V>T. a— OOOr-^fSSU 1 OK* 

Xf77103) *t. .x— fig*l OOtof-PS 
mm 1 OteJ: l )'raS^#J*BBBHit^9Wrf f - 
^frffl^T»WtMI«ffl*l 4 OtJ: 'Jt^Uff 
o. 

[0033] Xt -y 7* 1 0 4 ) ZIX. jl— fj|B*l 
0 O^T-^faSBl 1 OtcJ: 'J'SSSfijfcifcffifcSft 
SiiTv^gfjiOffC^KoftiKv^ft^r*^ FJE 

Xr-y 7*1 0 5 ) r^F^tT^SS^i 

fcff^eaifi»*#^B»is*E^-^3 o omm 

[00 34] 

4. #IIM!lOflirJgt l/C. a-fW#l OOOr-? 
l^gfl 1 oil. ft^avyFfcSRdMNaW&f 47 
y**iaKS*lTV^7^^a>'7 i — 7/W6 0 0* ■ 

«fWFl 0-34739 6#t:BaS<i , rv^*> fctt, 

77^ 3 >r-7;u6 o oicie^sntv^r^ v 9 > 
fc*tt?f 4*rafcfr3 tot-r 4. 

[0035] OT<OjatWCJi. ft^iSfflffib t-c . 

^o-^js^io 3 <ws«r«eB2Eiat *j tt * w?fB« 

0 0£JBWt2b47-/l'F5 0 0t#jD-f 4a— f 5 1 

^ISV-zi- F 5 0 0 mzft&t&tt^y?? 5 

<t a&77 is a vt- 7;w6 o o izm^^xmmn *> 

1 0 0 3 6 ] 07te, *$HH«0-SSftfi*02S;7 ? -** 
-XOfft££Srr. HBK*"f*ffif ? -^^-X2 1 0 

TOBttttfeSC 1 o<07 r 4 /Wl 0 IT 
mt07T4)UZ'm8.Ztl&. BMX'li. lOCD7r-f 

[0037] *I§lSi4. l o<7#»fctt*>ii*#WI 

4. COWCtt, Ht»«M0*B*iv r I J EPCDORIE 



[0038] saanrtt, io<o*i:i/c, 

j£$iiT^4a>£ftUT04. «IOS:)£c7)*IE^'ai4lil 

• Snumber=($l I $2 I $3) ; r 1 j r 2 j. 
(4, l"3j (4 'numberj bth. 

■ $num=$number$ # ; •" l#j ££i4s r 2#j ifc 
{4, r3#j jj r nu mji fc-f4. 

• $di recti on=$mf ; rflifj li fd i rect i onj t 
1-4. 

• $dir=$direction$£ ; rflffcj \$ IT d i r j ft4„ 

• nujnber=($num$dir | $dir$num) ; >" l^j 

r2#j afctt. r 3^j tfo rffrfcj 4fc(i» r fr 
fcj r i#j ifett r2#j r 3#j (4 

fnumb e r j fc"f4. 

• $sentence=$numdir$^i; ; r 1 # j * Ttli, r 2^j 

iTtti, r 3#j *>o rfrtcj rurCj 
r l#j 4^tt r 2#j ifett, r 3#j *»o rffiJj 

li fsentencej tt5. 
[00 39] t^oT r l#8iTtC#i!lJ t> r BUlCl#^ 

ilj i ri#fT^ilLTTS^J t(3|l:«i*t : 5r4. 

*?t. l-oo7T^;P«t2o<7)A'-x*3yfflfg*»'S) 

-^*3>'fflf83!! i S)4. ifi4>t«fflt*«^Wi, 

1 0Ol7r^;^t-J)4 2o<7)yN'-i/ 

3 yffifgfc LT . -ott. 1 7 r 4 ;i^«c*X»raif 

-^'2 o o turn ■ mmthmmmmmt^<r>mmzii 

0Hfrf4 fc * fc. Mfr • *W§^4A-^3 VmX' 

hi, iw^avMit a*-^'3 y##tf^jsa 
m^**). v-frv^mzmix&M'vit&tf&m* 
(mmnx-imzmztty-jivx'immm* 
mt&>mtffo&) e, ^ai^-t-A^oo^^- 

0 O^MLT^a^ftOSffSrff 3 fc SicfUffl 

?it4. 

[0040] t> a-o«JSf-^"<-^2 10^)17 
r )V% iz h h a'- V 3 y ft fgti , Sff^Hff B • mi 
•*»4>*») . a— 0 0*^oXaf^Bet«J:4^ 
ftr-^<-7.2 1 0^)7t^ ;HBW5K, -tOMifH 

*1 0 0<0AiS3»fB*»l 5 0Kf-^<-^ki 
^7 =r - v -y F * { |S] tX'h 4 r- aSE 1 1 0 CJEH 

{4, H«(0^cJ>4>'N'-> ; 3>tf^^^^J! ! a^<J: 
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